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INTRODUCTION 

>  Machine  intelligence  for  autonomous  systems  must  be  capable  of  learning  and 
especially  thinking,  if  we  are  to  go  beyond  the  'islands  of  autonomy1  presently 
envisioned  for  teleoperated  and  remotely  piloted  vehicles.  One  approach  is  to 
use  the  mammalian  brain  as  a  model  and  investigate  the  possibility  of  dupli¬ 
cating  its  functions  in  electronic  circuitry.  This  extension  of  neural  network 
design  is  called  non-living  intelligence  (NLI). 

The  brain  consists  of  approximately  10**12  neurons  intricately  intercon¬ 
nected.  Only  a  small  part  of  this  circuitry  has  been  unravelled.  The  NLI 
effort  at  Benet  Laboratories  does  not  describe  how  the  brain  works,  but  involves 
electronic  and  computational  experiments  that  provide  insight  into  how  the  brain 
might  work.  Me  pursue  NLI  through  the  design  and  construction  of  feeling¬ 
thinking  machines.  Feeling  is  essential  because  without  motivation,  there  is 
nothing.  The  machine  must  want  to  do  things.  In  doing  things,  it  will  learn; 

and  having  learned,  it  will  think.  This  report  does  not  describe  machines  that 

> 

"exhibit  intelligent  behavior";  but  rather  machines  that  feel,  want,  and  think. 
The  distant  goal  is  to  create  a  machine  that  thinks  and  acts  like  a  man.  This 
report  discusses  the  first  of  a  series  of  feeling-thinking  machine  designs. 

( 

THE  MODEL 

Our  approach  to  designing  this  machine  is  to  simulate  a  primitive  organism 
which  must  survive  within  a  contrived  universe.  We  have  given  it  the  name 
"Pacrat".  Pacrat's  brain  has  eight  brain  centers.  The  electrical  activity  of 
these  neural  centers  is  not  modeled,  only  the  functional  relationships.  From 
these  interactions  arises  a  sophisticated  structure  which  rests  upon  the  anatomy 

References  are  listed  at  the  end  of  this  report. 


of  Pacrat's  brain.  The  neural  centers  modeled  are:  the  reticular  ascending 
substance  (RAS),  the  thalamus,  the  hypothalamus,  the  amygdala,  the  cingulate 
gyrus,  the  medial  forebrain  bundle,  the  hippocampus,  and  the  isocortex  (ref  1). 

Individual  neural  response  is  not  simulated,  only  the  activity  of  assem¬ 
blages  of  neurons  called  codons.  A  codon  is  the  result  or  record  of  an 
experience.  It  exists  as  the  altered  synapses  between  the  neurons  which  consti¬ 
tute  the  assemblage  (refs  2,3). 

Pacrat,  in  diagrammatic  form,  is  shown  in  Figure  1.  It  shows  that  he  has 
been  provided  with  the  ability  to  get  about  in  his  universe  through  four  motor 
neurons.  These  are  driven  by  the  motor  area  of  the  isocortex  as  a  final  result 
of  sensory  input,  channeled  to  the  isocortex  under  the  control  of  the  thalamus, 
and  filtered  through  the  isocortex  under  the  influence  of  the  prevailing  emo¬ 
tion. 

Hunger  is  the  level  of  neural  activity  in  an  area  of  the  hypothalamus  which 
we  will  call  the  hunger  center  (ref  4).  The  model  assumes  there  are  sensory 
neurons  lining  the  stomach  wall  that  respond  to  expansions  and  contractions  of 
the  stomach.  These  determine  the  level  of  activity  of  the  hunger  center.  As 
the  stomach  empties,  the  hunger  center  becomes  more  active;  as  the  stomach 
fills,  it  becomes  less  active. 

Anger  is  also  a  level  of  neural  activity  in  an  area  of  the  hypothalamus, 
but  in  this  case  the  cause  is  the  activation  of  certain  codons  in  the  isocortex 
as  mediated  through  the  amygdala.  When  this  area  is  active,  Pacrat  experiences 
some  level  of  anger  or  frustration.  The  activity  in  the  amygdala  is  quickly 
inhibited  by  eating  (refs  5,6). 


Fear  is  the  level  of  activity  of  the  cingulate  gyrus.  This  activity  is, 
subjectively,  unease  escalating  to  terror.  In  Pacrat,  it  is  assumed  that  sen¬ 
sory  neurons  excite  the  cingulate  gyrus  whenever  his  back  is  uncovered.  This  is 
agoraphobia,  the  fear  of  open  places. 

Curiosity  is  the  level  of  activity  of  the  hippocampus.  It  is  set  off  by 
the  activation  of  a  codon  in  the  isocortex  which  has  not  previously  been 
excited.  The  continual  excitation  of  "old"  codons  will  allow  this  activity  to 
fade  away.  Pacrat's  hippocampus  has  efferents  on  his  motor  area  with  the  result 
that  "newness”  leads  to  exploratory  rather  than  hunger  or  fear-driven  activity. 

All  sensory  input  (other  than  olfactory)  is  gated  through  the  thalamus  to 
the  isocortex.  Thus,  the  thalamus  can  relay  or  block  this  input.  It  can  also 
inhibit  the  motor  output  that  would  normally  result  from  activity  in  the  isocor¬ 
tex.  The  thalamus  does  this  in  a  rhythmic  manner  when  the  reticular  ascending 
substance  (RAS)  is  stimulated.  The  RAS  is  excited  whenever  the  hypothalamus  or 
the  cingulate  gyrus  is  active. 

The  thalamus  extends  this  period  of  choking  off  sensory  input  when  it 
receives  impulses  from  a  codon  through  synapses  which  have  been  facilitated  in 
the  past  by  the  reward-punishment  mechanism.  This  blocking  of  sensory  input  and 
an  associated  inhibition  of  motor  output  is  the  function  of  the  thalamic  reticu¬ 
lar  complex.  On  the  other  hand,  if  a  codon  is  activated  which  has  a  facilitated 
synapse  on  the  "goal"  area  of  the  thalamus  (cf.,  akinetic  mutism,  (ref  7)),  sen¬ 
sory  input  is  gated  to  the  isocortex  and  the  motor  output  is  enabled. 

The  normal  activity  of  the  isocortex  is  association.  During  each  "moment” 
there  is  an  active  codon  which  has  efferents  on  the  motor  output  system.  If 
this  system  is  not  inhibited,  motor  output  will  follow.  This  codon  fades  out  as 


its  store  of  strategic  molecules  becomes  temporarily  depleted.  As  it  fades  out 
another  codon  starts  up  and  the  next  "moment"  begins.  The  new  codon  is  deter¬ 
mined  by  the  sensory  input  (if  not  blocked),  the  previously  excited  codon,  and 
the  current  dominant  emotion. 

A  reward-punishment  mechanism  is  started  up  by  the  medial  forebrain  bundle 
whenever  activity  in  the  hypothalamus  or  cingulate  gyrus  is  reduced.  The  role 
of  this  mechanism  is  to  facilitate  all  recently  fired  synapses  (ref  6). 

THE  IMPLEMENTATION 

Pacrat  exists  in  a  contrived  universe:  a  very  simple  universe  which  is  seen 
as  partitioned  by  a  rectangular  grid  (Figure  2).  At  each  location  in  the  grid 
one  of  Pacrat's  sensory  neurons,  unique  to  that  location,  becomes  active.  This 
gives  him  a  location  sense.  At  genesis  he  does  not  know  where  one  location  is 
relative  to  another,  but  he  does  know  that  he  is  where  he  is.  He  has  also  been 
given  the  ability  to  sense  his  own  trail,  and  has  a  general  adversion  to  going 
where  he  has  recently  been.  Again,  the  individual  activity  of  the  sensory 
neurons  is  not  simulated,  only  the  relationship  with  other  active  neurons.  His 
burrow  (or  starting  point)  is  always  at  row  11,  column  1.  This  is  indicated  by 
blue  shading  in  that  cell.  Pacrat's  current  location  is  given  by  the  green  cell 
(refs  8,9). 

One  codon  is  active  at  any  time  and  this  represents  a  'moment'  in  Pacrat's 
life.  This  codon  is  excited  by  current  sensory  input  to  the  isocortex  plus  the 
previously  excited  codon  and  the  prevailing  emotion.  The  inputs  are  the  loca¬ 
tion  sense,  which  is  gated  through  the  thalamus  (Figure  1),  smell,  the  axonal 
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bundles  fro*  the  hypothalamus,  and  cingulate  gyrus.  A  codon  In  the  simulation 
Is  simply  a  vector  of  scalars  representing  the  current  sensory  input  (if  any), 
normalized  synaptic  weights  to  the  four  motor  neurons,  associative  connections 
to  other  codons,  dominant  emotion,  and  synaptic  weights  to  the  amygdala, 
thalamus,  and  hippocampus  (ref  10). 

Pacrat's  motivation  is  hunger  and  fear.  When  awake,  Pacrat  is  forced  to 
move  by  one  or  the  other,  or  else  he  just  goes  to  sleep  as  the  RAS  quiets  down 
(ref  4).  Initially,  this  drive  is  hunger.  In  the  simulation,  the  distension  of 
the  stomach  is  represented  by  a  scalar.  This  number  continually  decreases 
unless  Pacrat  is  at  a  food  spot  and  is  eating.  When  this  number  is  low  enough, 
the  hypothalamus  responds  (again  a  scalar)  and  the  RAS  is  excited.  Pacrat  wakes 
up.  He  is  forced  to  explore  his  universe  for  food  to  satisfy  hunger.  Food  is 
placed  randomly  in  one  of  three  locations.  The  three  potential  food  spots  are 
shown  on  the  right  side  of  the  grid,  with  food  located  in  the  cell  shaded  blue. 
When  he  reaches  a  food  spot,  he  eats,  his  stomach  fills  up,  and  the  activity  in 
the  hypothalamus  Is  significantly  reduced.  This  Is  simulated  by  simply 
increasing  the  number  corresponding  to  distension  of  the  stomach  which  is  sensed 
by  the  neurons  lining  the  stomach  wall.  These  neurons  have  efferents  to  the 
hypothalamus. 

Pacrat  can  move  north,  south,  east,  and  west  within  the  boundaries  of  his 
universe.  Motor  neurons  drive  Pacrat  in  one  of  these  directions  one  cell  at  a 
time.  Each  active  codon  in  the  isocortex  has  efferents  on  each  of  these  motor 
neurons  and  the  relative  effectiveness  of  these  efferents  determines  the  direc¬ 
tion  of  travel.  At  the  outset,  i.e.,  trial  1,  there  is  no  preferred  direction 
of  movement.  The  synaptic  weights  fro*  any  given  codon  to  the  motor  neurons  are 
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Identical.  Pacrat  aoves  about  his  universe  randoely  until  food  is  found.  When 
it  is,  a  reward  mechanism  is  activated  through  the  medial  forebrain  bundle  which 
facilitates  all  recently  fired  synapses.  This  is  learning  and  will  generate  a 
preferred  direction  of  movement  when  similar  codons  are  active  in  the  future. 

The  vectors  representing  codons  are  changed  so  that  elements  corresponding  to 
synaptic  connections  between  simultaneously  active  neurons  are  increased. 
Facilitation  is  proportionally  lower  for  codons  active  earlier  in  time. 

After  hunger  is  satiated  and  the  level  of  activity  of  the  hypothalamus 
reduced,  fear  is  no  longer  masked  by  hunger.  Fear  keeps  the  activity  of  the  RAS 
high.  An  active  cingulate  gyrus  drives  Pacrat  back  to  his  burrow.  Again,  if 
this  is  the  first  trial,  there  is  no  preferred  direction,  but  the  codons  which 
are  activated  are  those  associated  with  fear  rather  than  hunger.  The  neurons  in 
the  cingulate  gyrus,  not  the  hypothalamus,  excite  neurons  in  the  Isocortex. 

When  his  burrow  is  reached,  Pacrat's  back  is  covered.  The  activity  of  the 
cingulate  gyrus  is  abruptly  decreased.  The  reward  mechanism  is  again  activated 
through  the  medial  forebrain  bundle  and  recently  fired  synapses  are  facilitated. 
This  will  generate  biased  movement  in  the  future  if  these  codons  are  active. 
Henceforth,  at  any  cell  in  the  grid,  he  will  tend  to  go  in  a  direction  depending 
on  which  neurons  are  active  in  the  brain  centers.  An  active  hypothalamus  may 
move  him  east;  an  active  cingulate  gyrus  with  the  same  sensory  input  may  drive 
him  north. 

During  epigenesis,  Pacrat  learns  to  survive.  Randomness  forces  Pacrat  out 
of  obsessive  behavior  patterns.  Although  a  reward  mechanism  may  increase  synap¬ 
tic  strength  between  a  codon  and  a  given  motor  neuron,  there  is  always  a  chance 
Pacrat  will  move  in  a  different  direction  A  built-in  random  element  raises  the 


level  of  activity  of  motor  neurons  with  a  lower  synaptic  weight  to  the  currently 
active  codon.  An  active  hippocampus  increases  the  effect  of  this  random  ele¬ 
ment.  If  this  were  not  present,  Pacrat  would  not  survive.  Once  food  were 
found,  he  would  follow  the  same  path  again  and  again.  However,  as  the  synaptic 
strength  between  a  codon  and  motor  neuron  is  increased,  it  becomes  more  and  more 
difficult  for  Pacrat  to  alter  his  behavior.  He  will  continue  searching  for  food 
in  locations  where  it  does  not  exist.  To  resolve  this  we  have  given  Pacrat  an 
amygdala.  An  active  amygdala  mediates  anger.  Excited  neurons  in  the  amygdala 
generate  unique  active  codons  in  the  isocortex.  Figure  1  shows  the  role  of  the 
amygdala  in  Pacrat.  When  the  reward  mechanism  is  active,  all  recently  fired 
synapses  are  facilitated  through  the  medial  forebrain  bundle.  These  include 
synapses  from  the  active  codon  in  the  isocortex  to  the  amygdala.  Therefore,  if 
this  same  codon  is  excited  in  future  trials,  the  amygdala  also  becomes  highly 
active.  This  high  level  of  activity  excites  a  region  in  the  hypothalamus  asso¬ 
ciated  with  anger  or  frustration.  Unless  there  is  a  concurrent  good  experience, 
such  as  eating,  which  will  inhibit  the  amygdala,  Pacrat  will  become  angry.  In 
other  words,  he  gets  mad  when  food  is  not  where  it  is  supposed  to  be.  This 
anger  quickly  drives  Pacrat  out  of  the  vicinity  of  a  food  spot  by  exciting  dif¬ 
ferent  codons  in  the  isocortex.  These  codons  do  not  have  synaptic  weights  to 
the  motor  area  that  favor  any  given  direction.  He  is  effectively  'bounced'  ran¬ 
domly  to  neighboring  locations  in  the  grid.  Without  the  amygdala,  Pacrat  would 
keep  looking  for  food  in  the  same  spot  almost  indefinitely.  The  level  of 
activity  in  the  hypothalamus  is  far  greater  than  that  of  the  hippocampus.  When 
he  is  starving,  he  doesn't  get  bored. 
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The  effect  of  rhythnic  action  of  the  thalamus  is  that  a  moment  (active 
codon  n)  that  generates  motor  output  is  followed  by  several  moments  (active 
codons  n+1,  n+2,...)  with  motor  output  inhibited.  This  is  the  first  of  three 
forms  that  thinking  takes.  The  sensory  input  is  temporarily  blocked,  motor  out¬ 
put  inhibited,  and  associated  codons  in  the  isocortex  are  turned  on.  This  form 
of  thinking  is  implemented  in  Pacrat  as  he  effectively  evaluates  the  conse¬ 
quences  of  his  last  move. 

A  second  form  of  thinking  comes  about  when  an  excited  thalamus  results  in 
an  extended  period  of  blocking  of  sensory  input.  Again,  the  normal  state  in  the 
isocortex  is  association  so  codons  continue  to  fade  in  and  out.  If  the  chain  of 
associating  codons  reaches  a  codon  with  inhibitory  efferents  on  the  thalamus, 
activity  of  neurons  in  the  reticular  complex  is  reduced.  The  blocking  cycle  of 
sensory  input  is  reduced  to  a  minimum  and  Pacrat  proceeds  to  move  with  intent. 
This  form  of  thinking  is  recognition.  It  is  initiated  when  Pacrat  moves  to  an 
area  of  particular  interest  to  him  on  the  grid.  This  is  a  location  where  synap¬ 
ses  from  the  isocortex  to  the  thalamus  have  been  facilitated  from  previous 
rewards. 

A  third  form  of  thinking  comes  about  when  the  extended  period  of  blocked 
sensory  input  and  inhibited  motor  output  results  in  slightly  different  asso¬ 
ciated  codon  chains.  This  can  occur  because  of  the  inherent  randomness  of 
neural  actions.  If  one  of  these  chains  results  in  activating  a  codon  quicker 
than  recent  paths  have  done,  the  neurons  of  this  codon  are  in  a  different  state 
of  molecular  depletion.  It  has  had  less  time  to  recover  from  the  last  activa¬ 
tion.  It  coses  on  with  a  burble  which  is  transmitted  to  the  reward  system,  and 
recently  fired  synapses  are  facilitated.  This  is  insight  and  is  the  basic 
mechanism  of  rational  thought.  Pacrat  has  demonstrated  this  by  "thinking"  of 
more  efficient  paths  to  food. 
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TRIAL  RUN 


Figure  3  shows  four  static  displays  of  a  typical  trial  run  of  the  simula¬ 
tion.  Figures  3a  through  3d  are  snapshots  in  trial  702.  The  activity  of  the 
brain  centers  is  given  by  a  red  bar  chart  on  the  left  side  of  the  display.  The 
larger  the  bar,  the  more  active  that  area  of  the  brain.  Even  number  trials 
(i.e.,  702)  display  the  effect  of  a  particular  neural  center  (i.e.f  hunger, 
anger),  while  odd  number  trials  (i.e.,  703)  give  the  name  of  the  center.  The 
number  of  steps  indicates  the  sequence  of  each  snapshot  in  the  trial. 

In  Figure  3a  Facrat  has  just  left  his  burrow,  the  starting  point.  The 
activity  of  the  hypothalamus  was  high  enough  to  activate  the  RAS  and  wake  him 
up.  Figures  3a  through  3c  show  Pacrat  driven  by  hunger.  Through  epigenesis, 
which  is  his  previous  701  trials,  he  has  learned.  Figure  3b  shows  Pacrat  with 
his  motor  output  inhibited  by  the  thalamus.  This  is  shown  by  freezing  him  at 
his  current  location  and  changing  his  color  to  a  deep  red  while  dynamically 
displaying  his  codon  association  chain  in  yellow.  The  reward  cell  for  this 
trial  is  in  the  middle  of  the  three  possible  food  locations  (row  11,  column  18). 
From  past  experience,  food  has  been  known  to  be  located  in  the  last  reward  cell 
(row  19,  column  18).  Pacrat's  codon  chain  eventually  associates  to  this  loca¬ 
tion,  and  facilitated  synapses  from  the  Isocortex  stop  the  thalamus  from 
blocking  sensory  input  and  inhibiting  the  motor  area.  Pacrat  is  green  when  his 
motor  output  is  not  Inhibited.  Figure  3c  shows  the  active  amygdala  when  food  is 
not  found  where  it  was  expected.  Pacrat  turns  purple  when  the  activity  at  the 
amygdala  exceeds  a  given  threshold. 

His  frustration  forces  him  out  of  the  vicinity  of  the  empty  food  cell  and 
eventually  he  locates  the  food.  Figure  3d  shows  Pacrat  moving  with  Intent  back 
to  his  burrow,  driven  by  fear.  Pacrat  is  green,  indicating  that  motor  output  is 
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not  disabled.  The  activity  in  the  thalamus  (thinking)  indicates  it  has  been 
inhibited  fro*  blocking  sensory  Input  and  fro*  inhibiting  motor  output.  This  is 
a  result  of  recognition  resulting  in  strong  Inhibitory  input  from  the  isocortex. 

IMPLEMENTING  PACRAT  AS  A  NEURAL  NET 

A  simplified  version  of  Pacrat  has  been  implemented  using  only  simulated 
neurons,  formal  definitions  of  neural  activity,  and  synaptic  facilitation. 

Neural  activity  is  modeled  using  PID  (proportional-integral-differential) 
control.  The  governing  equations  for  cell  activity  and  synaptic  facilitation 
are  given  in  Figure  4.  Synaptic  facilitation  has  both  a  Hebbian  (associative) 
and  a  non-Hebbian  (reward-punishment)  component. 

This  simulation  is  called  Mouse.  Figure  5  gives  a  static  display  at  one 
point  in  the  simulation.  The  shaded  circles  on  the  left  represent  neurons. 
Mouse,  like  Pacrat,  lives  in  a  bounded  universe.  This  universe  is  the  ten  by 
ten  grid  on  the  right.  At  each  cell  in  the  grid,  a  single  sensory  neuron 
becomes  active.  The  color  of  the  circles  reflects  the  activity.  The  color 
changes  gradually  fro*  blue  to  red  to  white  as  the  activity  Increases.  Each 
sensory  neuron  has  excitatory  efferents  on  each  of  four  motor  neurons.  These 
motor  neurons  are  labelled  N  (north),  S  (south),  E  (east),  and  W  (west).  When 
the  activity  of  one  of  these  motor  neurons  exceeds  a  preset  threshhold.  Mouse 
moves  one  cell  in  that  direction  (within  the  boundaries)  and  a  different  sensory 
neuron  becomes  excited.  As  in  Pacrat,  there  are  three  potential  reward  cells. 

At  the  beginning  of  each  trial,  food  is  placed  randomly  in  one  of  these  cells. 
These  cells  are  the  three  blue  cells  in  column  9  as  shown  in  Figure  5.  The  dark 
blue  cell  gives  the  location  of  the  reward  cell  for  that  trial.  When  Mouse 
reaches  a  cell  where  food  is  located,  a  reward  mechanism  is  activated  and 
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recently  fired  synapses  are  facilitated.  The  normalized  synaptic  weights  from 
the  sensory  neurons  to  the  motor  neurons  are  shown  by  the  arrows  in  the  grid. 
There  is  always  an  element  of  randomness  associated  with  each  move,  but  the 
larger  the  arrow  the  more  likely  House  will  move  in  that  direction.  Initially, 
(i.e.,  trial  1)  Mouse  has  no  preferred  direction  of  movement  and  the  arrows  have 
zero  length  and  direction.  Figure  5  gives  the  normalized  weights  after  1000 
trials.  House  always  starts  at  row  6,  column  1,  which  is  shaded  dark  blue.  He 
is  displayed  as  a  green  square.  In  order  to  avoid  obsessive,  compulsive  behav¬ 
ior,  Mouse  has  been  given  a  sense  of  smell.  He  is  designed  to  avoid  his  own 
trail.  This  is  accomplished  via  four  sensory  neurons  with  Inhibitory  efferents 
on  the  motor  neurons.  These  are  labeled  1/N,  1/E,  1/S,  and  1/M  indicating  their 
effect  on  that  direction  of  travel.  The  necessity  for  these  is  evident  if  one 
imagines  four  arrows  in  the  grid  forming  a  loop. 

Figure  5  shows  Mouse  after  a  single  move.  He  has  just  moved  north  so  there 
is  a  high  level  of  neural  activity  in  the  neuron  inhibiting  motor  neuron  S 
(south).  Since  this  is  the  1000th  trial,  Mouse  has  a  preferred  direction  of 
movement.  At  this  location,  as  shown  by  the  arrow,  it  is  east.  The  large 
synaptic  weighting  from  the  currently  active  sensory  neuron  to  motor  neuron  E 
(east)  is  raising  the  activity  of  this  motor  neuron  more  than  the  others.  It  is 
therefore  likely  that  Mouse  will  move  east. 

CONCLUSIONS 

A  brassboarded  feeling-thinking  machine  is  possible.  We  believe  it  is  not 
practical  at  the  moment  to  consider  casting  everything  in  silicon,  therefore  the 
neural  network  section  of  the  machine  will  be  emulated  in  a  highly  parallel  com¬ 
puter  ensemble. 
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ONGOING  EFFORTS 

The  Pacrat  simulation  is  being  completely  rewritten  so  that  the  neurons  are 
explicitly  modeled.  This  is  preparatory  to  moving  the  simulation  to  a 


transputer  network  running  under  an  Occam  harness. 
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CELL  ACTIVITY  (PIP 


1  ■  postsynaptic  ,  j  ■  presynaptic 

.0  .  + 

Xi  >  [AXi  *  B  f  (Kj  -  X-j  )dt  +  CX  ♦  D*XI  ♦  E*R] 

XI  -  XI  ♦  F*(IXjWij  -  X,) 

X  ■  cell  activity 

Ki  «  resting  frequency 

Wij  «  synaptic  weight 

A,B,C,0,E,F  a  empirical  constants 

R  «  rectangular  distribution  on  (0.0, 1.0) 

SYNAPTIC  FACILITATION 

,0 

Wij  .  -AWij  ♦  B*H(Xi,Xj)  ♦  T(R,P)*a*  /  H(Xi ,Xj)dt 
a  a  Ca  ♦  D*H(Xi,Xj) 

T(R,P)  -  E*R  ♦  F*P 
H(Xi,Xj)  -  (Xi-Ki]+[Xj-Kj] 

A,B,C,D,E,F  «  empirical  constants 
Ki,Kj  ■  resting  frequencies 
R  «  instantaneous  reward  level 
P  >  instantaneous  punishment  level 
R  ■  P  ■  0  or  E  ■  F  ■  0  ■>  Hebbian 

Figure  4.  Cell  Activity  and  Synaptic  Facilitation. 
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